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We examine the three-step master equation hom the standpoint of the general 
solution of the associated discrete Riccati equation. We report by this means stationary 
master solutions depending on a free constant parameter, denoted by D, that should 
' be negative in order to assure the positivity of the solution. These solutions correspond 

^ ■ to different discrete Markov processes characterized by the value of D, which is related 

OO ' to specific renormalizations of the transition rates of the chain of states. 

\o ■ 

' In general, the three-step population master equation is used by physicists in 

, many studies of diffusion processes of microscopic particles on one-dimensional 

' lattices PP, but this simple discrete equation has extensive and interesting ap- 

, plications in other fields as well, most recently to Hubbell's neutral theory in 

' ecology In the following, we shall use a population interpretation. It reads 

(— I . = dn+lPn+1 — CTnPn + bn-lPn-1 , Cn, — K + dn , (1) 

e where 6„ is the transition rate for the birth-type jump n —>■ n + 1 and d„ is the 
death- type rate for the backward jump n — > n — 1, while p„ is the probability 
^ , to have n individuals at the instant t. Employing the initial conditions fe-i = 

' do = 0, the known stationary solution is, 




(2) 



where Pq is a scaling constant that through the probabilistic normalization 
condition can be written as Pq = '^n=i Tl^=o rf~tr^ 

We proceed now to show that stationary solutions which are different of Eq. (j^J 
can be obtained that are based on the general solution of the discrete Riccati 
equation connected to the master equation. Indeed, performing the transforma- 
tion 

= + , n ^ , (3) 
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in Eq. ^ leads to the following discrete Riccati equation 

Vn = o„_ij/„y„_i — (1 - (T„+i)y„-i + dn+i H 

Or) On 



with the particular solution 



1 - 
bn 



(4) 



(5) 



However, it is easy to check that one can write a more general solution of Eq. (0J 
as follows 



fn 



_ Y^n fkbk+1 



/"=n 



i=0 



bidi+2 



(6) 



where D is a real constant. 

Using simple discrete algebra, one can obtain the recurrence relationship 



n+l 



Pn y 



leading to stationary solutions of the following form 



to ^^+1 V 



i+l 



'■j + 2 



Ml. 

di+i 



(7) 



(8) 



where the normalization constant reads 

N ri-1 



Po = 



1 



H -1 



i+l 



^ di+i\ |n| + v* 



di+i / J 



(9) 



Examining Eq. ((HJ with normalization 0, we first notice that for D — > —oo we 
recover the known case of stationary master solution with the common normal- 
ization. In addition, we notice that the factor 



fA/d, 



i+l 



looks like a renormalization factor for the transition rates of the original station- 
ary Markov process. A reasonable interpretation of D depends on the specific 
application and in general is related to initial conditions, boundary conditions, 
or external applied fields. In addition, for a physical solution one requires posi- 
tivity implying 

bt ^ b^^i 
di+i di 

This is a strong condition and in particular cases it could be relaxed. 
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a) . The most trivial case is bk = dk = const < 1, k = 0,...,n. This implies 
P^* = Po; the Riccati solution is ijk = b^^ — 1. The Z?-dependent solution will 
be 

n. = p(l + ;^) (10) 
and with the normalization explicitly calculated 

A plot of Pfe for various values of the parameter D is shown in Fig. (1). 

b) . For the asymmetric case we take fe„ = ^(1 + e), d„ — i(l — e), q = < 
1, n — 0, ...N, and the parametric solution reads 

f-J^ {l-q)D + l-q' ' ^ ^ 

and the normalization constant can be easily written down from Eq. I^. Plots 
for this case are displayed in Fig. (2). 

c) . Various other cases are presented in Figures (3) - (5) for exponential 
parametrizations of the jump rates. 

In summary, we report one-parameter stationary solutions of the three-step 
master equation that are based on the corresponding discrete Riccati gen- 
eral solution. In the continuous case, the mathematical method we employ 
here corresponds to Mielnik's procedure in supersymmetric quantum mechanics 
The parameter of these solutions could be fixed in applications by ini- 
tial/boundary conditions or through external perturbations of the underlying 
birth-death Markov process. 

It is well known that the stationary solution of the master equation of a 
discrete Markov process is uniquely defined if the process contains only one 
class of ergodic states. In this case, the stationary solution does not depend 
on the initial condition. The discrete Riccati mathematical procedure leads 
to modified transition rates and consequently to different stationary solutions 
that belongs to different master equations. Modifying the rates at the ends 
of the chain of states corresponds to a probability current flow through the 
system, i.e., to a driven system. Thus, the physical interpretation of this class 
of parametric master solutions is that they are a specific type of current-carrying 
solutions that are important non-equilibrium steady states in many mesoscopic 
and macroscopic systems, such as Becker-Doring nucleation processes jS], or 
superconductivity, where as stated by Geller [J], "it is now understood that 
supercurrent-carrying states are in fact, metastable non- equilibrium states ... 
with an extremely long lifetime" . The latter states are essential for the tunable 
supercurrent of Josephson junction technology 

If, for example, we place us in a population (ecology) context, the difference 
with respect to the original master equation is already at the level of the do rate. 
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For a finite D the rate do is not zero. Thus, for positive do, one can interpret 
this rate as an initial immigration rate, while for negative values as an initial 
emigration rate. 
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parametric stationary solution 
le-01 p — I — I — I — I — I — I — ^ — \ — I — : 




Figure 2: F„(-4) - black straight line; P„(— 40) - blue dotted line; P„(-oo) - 
red-dotted line, all of them for e = 0.02. 
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parametric stationary solution 
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Figure 3: Black straight line - P„(— 4); blue-dotted line is P„(— 4000); red- 
dotted-dashed line is P„(— oo)- for hi = 0.1 + exp[— 0.12z] and di = 0.1 + 
exp[— 0.15 i]. 
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Figure 4: P„(-4) - black straight line; P„(-4000) - blue dotted line; P„(-oo) - 
red-dotted line, for bi = cxp[— 0.12 i^/^] and di — exp[— 0.15 i^^^]. 
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parametric stationary solution 
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Figure 5: -Pn(-4) - black straight line; P„(-4000) - blue dotted line; P„(-cx)) - 
red-dotted line, for bi = 0.01 + exp[-0.15z] and rf,; = 0.01 + cxp[-0.12z]. 
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